On Input Selection with Reversible Jump Markov Chain Monte Carlo Sampling
نویسنده
چکیده
In this paper we will treat input selection for a radial basis function (RBF) like classifier within a Bayesian framework. We approximate the a-posteriori distribution over both model coefficients and input subsets by samples drawn with Gibbs updates and reversible jump moves. Using some public datasets, we compare the classification accuracy of the method with a conventional ARD scheme. These datasets are also used to infer the a-posteriori probabilities of different input subsets.
منابع مشابه
Population-based reversible jump Markov chain Monte Carlo
We present an extension of population-based Markov chain Monte Carlo to the transdimensional case. A major challenge is that of simulating from highand transdimensional target measures. In such cases, Markov chain Monte Carlo methods may not adequately traverse the support of the target; the simulation results will be unreliable. We develop population methods to deal with such problems, and giv...
متن کاملOn the Relationship Between Markov Chain Monte Carlo Methods for Model Uncertainty
This article considers Markov chain computational methods for incorporating uncertainty about the dimension of a parameter when performing inference within a Bayesian setting. A general class of methods is proposed for performing such computations, based upon a product space representation of the problem which is similar to that of Carlin and Chib. It is shown that all of the existing algorithm...
متن کاملBayesian Model Selection for Heteroskedastic Models
It is well known that volatility asymmetry exists in financial markets. This paper reviews and investigates recently developed techniques for Bayesian estimation and model selection applied to a large group of modern asymmetric heteroskedastic models. These include the GJR-GARCH, threshold autoregression with GARCH errors, threshold GARCH and Double threshold heteroskedastic model with auxiliar...
متن کاملAerosol model selection and uncertainty modelling by adaptive MCMC technique
We present a new technique for model selection problem in atmospheric remote sensing. The technique is based on Monte Carlo sampling and it allows model selection, calculation of model posterior probabilities and model averaging in Bayesian way. The algorithm developed here is called Adaptive Automatic Reversible Jump Markov chain Monte Carlo method (AARJ). It uses Markov chain Monte Carlo (MCM...
متن کاملTowards Automatic Reversible Jump Markov Chain Monte Carlo
Since its introduction by Green (1995), reversible jump MCMC has been recognised as a powerful tool for making posterior inference about a wide range of statistical problems. Despite enjoying considerable application across a variety of disciplines, the method’s popularity has been tempered by the common perception that reversible jump samplers can be difficult to implement. Beginning with a re...
متن کامل